Paradoxical Results in Multidimensional Item Response Theory
نویسندگان
چکیده
In multidimensional item response theory (MIRT), it is possible for the estimate of a subject’s ability in some dimension to decrease after they have answered a question correctly. This paper investigates how and when this type of paradoxical result can occur. We demonstrate that many response models and statistical estimates can produce paradoxical results and that in the popular class of linearly compensatory models, maximum likelihood estimates are guaranteed to do so. In light of these findings, the appropriateness of multidimensional item response methods for assigning scores in high-stakes testing is called into question.
منابع مشابه
On Separable Tests, Correlated Priors and Paradoxical Results in Multidimensional Item Response Theory
This note considers the problem of paradoxical results in multidimensional item response theory. This is the possibility that a deliberately incorrect response could be beneficial to an examinee. An example is created that demonstrates that, when three or more ability dimensions are considered, paradoxical results can occur for Bayesian estimates even for separable tests when all the dimensions...
متن کاملParadoxical Results and Item Bundles
Hooker et al. (2009) defined a paradoxical result as the attainment of a higher test score by changing answers from correct to incorrect and demonstrated that such results are unavoidable for maximum likelihood estimates in multidimensional item response theory. The potential for these results to occur leads to the undesirable possibility of a subject’s best answer being detrimental to them. Th...
متن کاملA simple descriptive method for multidimensional item response theory based on stochastic dominance
In this paper we develop a descriptive concept of a (partially) ordinal joint scaling of items and persons in the context of (dichotomous) item response analysis. The developed method has to be understood as a purely descriptive method describing relations among the data observed in a given item response data set, it is not intended to directly measure some presumed underlying latent traits. We...
متن کاملDetecting Multidimensional Differential Item Functioning with the Multiple Indicators Multiple Causes Model, the Item Response Theory Likelihood Ratio Test, and Logistic Regression
Citation: Bulut O and Suh Y (2017) Detecting Multidimensional Differential Item Functioning with the Multiple Indicators Multiple Causes Model, the Item Response Theory Likelihood Ratio Test, and Logistic Regression. Front. Educ. 2:51. doi: 10.3389/feduc.2017.00051 detecting Multidimensional differential Item Functioning with the Multiple Indicators Multiple Causes Model, the Item Response theo...
متن کاملOn multidimensional item response theory -- a coordinate free approach
A coordinate system free definition of complex structure multidimensional item response theory (MIRT) for dichotomously scored items is presented. The point of view taken emphasizes the possibilities and subtleties of understanding MIRT as a multidimensional extension of the “classical” unidimensional item response theory models. The main theorem of the paper is that every monotonic MIRT model ...
متن کامل